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1.  INTRODUCTION 

It  is  widely  recognized  that 
uncertainty  in  atmospheric  and  oceanic 
models  can  be  traced  back  to  two  factors 
(Lorenz  1984a,  1987).  First,  in  defining  the 
state  of  atmosphere  (or  ocean),  a  number  of 
errors  are  involved  arising  from  the  finite 
resolution  of  measurement  or  from 
discretization  in  a  numerical  experiment,  as 
a  result  of  which  small-scale  “subgrid” 
processes  are  either  discarded  or 
parameterized.  Second,  once  present,  small 
errors  of  the  kind  mentioned  above  trigger  a 
complex  response  leading  to  their 
subsequent  amplification.  The  model 
predictability  versus  boundary  condition 
error  was  discussed  by  Chu  (1999)  using 
the  Lorenz  system. 

The  model  predictability  can  be 
measured  by  two  parameters: 
instantaneous  error  (IE)  and  predictability 
time  (PT).  The  IE  and  PT  are  used  for 
models  with  and  without  given  initial 
condition  errors,  respectively. 

The  IE  measure  is  widely  used  for 
model  evaluation.  The  predictability  is 
regarded  as  the  model  error  growth  due  to 
the  initial  condition  error.  This  implies  that 
the  initial  condition  error  should  be  given. 
The  evaluation  process  becomes  to  study 
the  stability  of  the  dynamical  system  with  a 
given  initial  condition  error  and  to  determine 
either  the  leading  (largest)  Lyapunov 
exponent  (e.g.,  Lorenz  1969)  or  the 
amplification  factors  calculated  from  the 
leading  singular  vectors  (e.g.,  Farrell  and 
loannou  1996  a,  b).  It  is  well  known  that  the 
stability  analysis  using  the  Lyapunov 
exponents  and  the  singular  vectors  is  not 
unique  (Has'minskii,  1980).  Probabilistic 
stability  analysis  becomes  available  in 
practical  application  (Ehrendorfer  1994  a,  b; 
Nicolis  1992).  The  statistical  properties  of 
the  prediction  error  are  described  through 
the  probability  density  function  (PDF) 
satisfying  the  Liouville  equation  or  the 
Fokker-Plank  equation.  Solving  this 


equation,  we  may  calculate  the  mean  and 
variance  of  errors.  Nicolis  (1992)  explored 
the  probabilistic  properties  of  error-growth 
dynamics  in  the  atmosphere  using  a  simple 
low-order  model  (displaying  a  single  positive 
Lyapunov  exponent)  giving  rise  to  chaotic 
behavior.  A  large  number  of  numerical 
experiments  were  performed  to  assess  the 
relative  importance  of  average  and  random 
elements  in  error  growth. 

In  this  study,  we  first  develop  a 
theoretical  framework  for  predictability 
evaluation  using  the  PT  measure,  and  then 
to  illustrate  its  usefulness  using  the  one¬ 
dimensional  probabilistic  error  growth  model 
proposed  by  Nicolis  (1992). 

2.  PREDICTABILITY  ERROR 

2.1.  Dynamical  System  with 
Stochastic  Forcing 

Let  x(t)  =  [x<v(t),  x<2>(t),  x<n)(t)]  be  the 

full  set  of  variables  characterizing  the 
dynamics  of  the  atmosphere  (or  ocean)  in  a 
certain  level  of  description.  We  embed  the 
evolution  of  x(f)  in  a  phase  space  spanned 
by  the  whole  set  of  variables  [x(1>(t),  x<2>(t), 
x<n>(t)].  Let  deterministic  law  be  given  by 

^  =  f(x,0 

dt 

where  f  is  a  functional.  With  a  stochastic 
forcing  q,  Eq.(1)  becomes  a  stochastic 
differential  equation 
dx 

—  =  f  (x,t)  +  q(t)x  (1) 

dt 

Atmospheric  (or  ocean)  prediction  is  to  find 
the  solution  of  (2)  with  an  initial  condition 

x(t0)  =  x0  (2) 

where  x0  is  an  initial  particle  position  in 

the  phase  space.  For  simplicity,  we  assume 
in  this  paper  that  the  stochastic  forcing  g  is  a 
white  noise  with  zero  mean 

{q(t))  =  0  (3) 

and  variance  q2 

( q(t)q(t')}  =  q2S(t-t ')  (4) 


Report  Documentation  Page 


Form  Approved 
OMB  No.  0704-0188 


Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 
VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 


1.  REPORT  DATE 

2001 


2.  REPORT  TYPE 


3.  DATES  COVERED 

00-00-2001  to  00-00-2001 


4.  TITLE  AND  SUBTITLE 

Backward  FOKKER-PLANCK  Equation  for  Determination  of  Model 
Predictability  with  Uncertain  Initial  Errors 

6.  AUTHOR(S) 


7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Naval  Postgruaduate  School, Department  of 
Oceanography , Monterey  ,C  A  ,93943 


5a.  CONTRACT  NUMBER 


5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

5d.  PROIECT  NUMBER 


5e.  TASK  NUMBER 


5f.  WORK  UNIT  NUMBER 

8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 


9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 


10.  SPONSOR/MONITOR'S  ACRONYM(S) 


11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 


12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

A  National  Oceanographic  Partnership  Program  Award.  13th  Conference  on  Atmosphere  and  Ocean  Fluid 
Dynamics,  American  Meteorological  Society,  XX-XX,  2001 


14.  ABSTRACT 


15.  SUBIECT  TERMS 


16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 
ABSTRACT 

18.  NUMBER 

OF  PAGES 

19a.  NAME  OF 

RESPONSIBLE  PERSON 

a.  REPORT 

unclassified 

b.  ABSTRACT 

unclassified 

c.  THIS  PAGE 

unclassified 

Same  as 
Report  (SAR) 

6 

Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


where  the  bracket  <  >  is  defined  as 
ensemble  mean  over  realizations  generated 
by  the  stochastic  forcing  q(t),  and  8  is  the 
Delta  function. 


2.2.  Prediction  Model  and  Error 
Variance 

Let  y (t)  =  [y (1)(t),  f>(t),  y<n>(t))  be 

the  prediction  of  x(f)  using  a  prediction 
model 

~  =  h(y,0  (5) 

at 

with  an  initial  condition 


y(t0)  =  yo ■  (6) 


Difference  between  reality  (x)  and 
prediction  (y)  at  any  time  t  (>t0) 
z  =  x-y 


is  defined  as  the  prediction  error  vector  and 
this  difference  at  t0 


z0  =  x0-y0 

is  defined  as  the  initial  error  vector.  If  the 
components  [x(1>(t),  x(2>(t),  ...,  x(n>(t)]  are  not 
equally  important  in  terms  of  prediction,  the 
uncertainty  of  model  prediction  can  be 
measured  by  the  error  variance 

Var(z)=<zAz>  (7) 

with  an  nxn  diagonal  weight  matrix 


Ai  0 
0  Ai 


0 

0 


.(8) 


[0  0  ...  An] 

where  A1  ,  A2 ,  ...  An  are  non-negative  real 
numbers,  which  represent  relative 
importance  of  the  corresponding 
components.  Here,  the  superscript  prime 
indicates  the  transpose  of  the  prediction 
error  vector  z. 

3.  TWO  TYPES  OF  MODEL 
PREDICTABILITY  MEASURES 
3.1.  IE  Measure 

Use  of  the  IE  measure  is  usually 
associated  with  the  investigation  of  model 
error  growth  with  a  given  initial  error  Co 
IzoKo 
(9) 

For  example,  Nicolis  (1992)  defined  the 
ensemble  mean  IE 


^)=2Mn^x°^yoiz(0 

<?(l  z(to)\-Co) 


(10) 


to  evaluate  the  predictability  of  the  Lorenz 
attractor  (1984).  Here,  r  denotes  the  phase- 
space  region  belonging  to  the  attractor;  C~  \ 
z  |;  the  factor  (!4)  accounts  for  the  symmetry 
between  x  and  y;  and  p(r)  is  the  volume  of 
the  attractor.  Since  the  dynamical  system 
(1)  contains  stochastic  forcing,  the  ensemble 
mean  IE  is  a  random  variable  with  a 

probability  function  P  (C„t ),  which  satisfies 
the  Fokker-Planck  equation  (Nicolis  1992) 


dP  ,  dP 
—  +  f(x,0—  : 

dt  3x 


r 


(x2P) 


(11) 


2  r)xr)x 

3.2.  PT  Measure 

Without  knowing  the  initial  error  Co,  we 
cannot  use  the  IE  measure  to  evaluate  the 
model  predictability.  At  that  case,  we  may 
first  define  a  scalar  parameter,  e,  called  the 
tolerance  prediction  error.  The  prediction  is 
meaningful  only  if  the  error  variance  satisfies 
the  following  inequality 

Var(z)<^  (12) 

which  represents  an  ellipsoid  S^f)  in  the  n- 
dimensional  phase  space  (Fig.  1),  which  is 
called  the  predictability  ellipsoid.  At  any 
instance  t,  a  valid  model  prediction  is 
represented  by  a  time  period  (f  -  f0)  that  the 
stochastic  trajectory  z  is  still  in  the  ellipsoid 
Se  (t).  \J\le  may  define  (f  -  f0)  as  the  valid 


prediction  period.  Obviously,  this  parameter 
is  a  random  variable  since  the  trajectory  z  is 
stochastic.  The  joint  probability  density 
function  of  (f  -  f0)  and  z0  satisfies  the 
backward  Fokker-Planck  equation  (Section 
3.6  in  Gardiner  1983) 


dP 

Y 


[f(z0,O] 


dP 

dz0 


1  2  2  ?>2P 

—  q  z  ' - =  0 

2  3zn3z, 


J0V 


Jo 


(13) 

Suppose  the  prediction  error  vector  z 
moving  in  the  phase  space  (i.e.,  the 
prediction  errors  are  not  constant),  and 
suppose  the  tolerance  prediction  error  e  to 
be  sufficiently  small.  The  probability  for  z0  in 
the  ellipsoid  Se  (f)  is  zero  (Fig.  1), 


P(t0,z0G  S£(t),t-t0)  =  0  (14) 

which  is  the  boundary  condition  of  (13).  The 
probability  for  the  prediction  error  vector  at  t 
=  °°  is  zero, 


2 


Lim  P(t0,z0,t—t0)  =  0 

t— >oo 

and  the  temporal  integration  of  P(t0,  z0,  t  - 
t0)  from  t0  to  °°  should  be  one, 

| P(t0,z0,t-t0)dt  =  l  (15) 

h 

Since  P(t0,  z0,  t  -  t0)  is  the  probability  of  the 
valid  prediction  period  (f  -  f0)  with  the  initial 
error  vector  z0  at  f0,  its  first  moment 


T\  (zo)  =  \P(h’z0’t~tQ)(t-h)dt 

(16)  denotes  the  ensemble  mean  of  the 
valid  prediction  period,  or  called  PT.  Its 
second  moment 


f  =  f(zo) 

the  procedure  is  much  simpler.  We  multiply 
the  backward  Fokker-Planck  equation  (13) 
by  (f  -  t0)  and  (f  -  t0f  respectively,  integrate 
both  equations  with  respect  to  t  from  t0  to  °°, 
and  obtain  the  PT  equation 


dz0  2  dz0dz0 
and  the  VPT  equation 


(18) 


f(z0)^P+q  Z° 


d  T-, 


av. 


dz 


o 


dZgdZg 


=  —  2t,.(19) 


Both  (18)  and  (19)  are  linear.  Usually,  they 
have  analytical  solutions. 


f  2(z  o  )  =  J  P({o  ,zoP-t0){t-t0  fdt 

(17)  indicates  the  variation  of  the  valid 
prediction  period,  or  called  VPT.  The 
uncertainty  of  initial  condition  errors  is  easily 
taken  into  account  through  additional 
averaging  of  (16)  and  (17)  over  an  ensemble 
of  initial  perturbations. 


Figure  1.  Phase  space  trajectories  of  model 
prediction  y  (solid  curve)  and  reality  x 
(dashed  curve).  The  positions  of  reality  and 
prediction  trajectories  at  time  instance  are 
denoted  by  “*”  and  “o  ”,  respectively. 

3.3.  PT  and  VPT  Equations  for  an 
Autonomous  System 

Usually,  two  steps  are  used  for 
computing  PT  and  VPT:  (1)  to  obtain  P(t0, 
z0,  t  -  t0)  through  solving  the  backward 
Fokker-Planck  equation  (13),  and  (2)  to 
compute  PT  and  VPT  using  (16)  and  (17). 
For  an  autonomous  dynamical  system, 


4.  A  SELF-CONSISTENT  PROBABILISTIC 
ERROR  GROWTH  MODEL 

To  illustrate  similarity  and  dissimilarity 
between  PT  and  IE  measures,  we  use  the 
one-dimensional  probabilistic  error  growth 
model  (Nicolis  1992) 

=  (<?- g£2)  +  v(t)£ ,  0  <  £  <  °°  (20) 
at 

which  is  the  projection  of  a  self-consistent 
stochastic  error  growth  model  [from  the 
Lorenz  attractor  (Lorenz  1984)]  into  the 
unstable  eigenvector  £  corresponding  to  the 
positive  Lyapunov  exponent  o. 

(v(0)  =  0,  (v(t)v(t'))  =  q2 S(t  - 1') .  (21) 

The  parameters  in  the  error  growth  model 
(20)  are  chosen  by  Nicolis  (1992)  as 

<7  =  0.64,  g  =  0.3 ,  q 2  =0.2  .  (22) 

5.  EVALUATION  OF  MODEL 
PREDICTABILITY  WITH  UNKNOWN 
INITIAL  CONDITION  ERROR 

5.1.  PT  and  VPT  Equations 

Due  to  limited  sampling,  the  initial 
condition  errors  and  its  PDF  are  usually 

uncertain.  Without  knowing  P(%, 0)  and 

|t=o,  the  IE  measure  is  hardly  used  in 

predictability  evaluation.  However,  the  PT 
measure  is  easily  used. 

For  the  probabilistic  error  growth  model 
(20),  the  PDF  for  the  random  variable  (f  - 


3 


t0),  [i.e. ,  P(t0,  ^o,  t  -  f0)]  satisfies  the 
backward  Fokker-Planck  equation, 


(27) 


dP  r  „  21  dP 

^--k-^0Jvr 

df  0  d£0 

1  ^2jP  n 

- q  - =  0 

2 

and  the  ellipsoid  (12)  becomes  an  interval, 
0  <  4  <  f  . 


The  PT  and  VPT  equations  (18)  and  (19) 
become  ordinary  differential  equations 


(O£o-g£o) 


dr i  d  rx 

~df0+~l^ 


=  -l 


(28) 


(O^o-^o) 


dT^+q^d\1 
d{  o  2  #02 


=  -2n 


(29) 

When  the  initial  condition  error  reaches  the 
tolerance  level,  =  £,  the  model  capability 
of  prediction  is  lost  no  matter  how  good  the 
model  is,  and  xi  and  x2  become  zero, 

Tj  =  0,  T2  =  0  for  4b=£  (30) 


When  the  initial  condition  error  is  below  the 
noise  level,  £noise,  the  model  capability  of 
prediction  does  not  depend  on  the  initial 
condition,  and  X!  and  x2  do  not  depend  on 


& 

dr] 

dlo 


=  0, 


dr 


2  


d£  o 


=  0 


for 


(31) 

5.2.  Dependence  of  PT  and  VPT  on 

0’  ^ noise’ 


Solving  the  second-order  differential 
equations  (28)  and  (29)  with  the  boundary 
conditions  (30)  and  (31),  we  obtain  an 
analytic  solutions  for  xi 


2(7 


ri'i f  1-1  7  exp(^v) 


j 


2(7 

~7I 


exp(-  x)dx 

r 


dv 


and  for  x2 


(32) 


X  2<r 
X2 


T2 £  0’  ^ noise’  £">  =  ^  j  ^  CXp(^V) 


So 


7  Za  _7 

p  z  z 

I  Tj(x)x q  exp( 


. 

noise 


2  eg 
q2 


x)dx 


dy 

(33) 


where 

£  0  —  9  0  ^  £  '  £ noise  ~  £ noise  ^  & 

are  the  initial  condition  error  and  noise  level 
scaled  by  the  tolerance  error  e. 

Figures  2  and  3  show  the  contour 

plots  of  rX£  .  ,£)  and  r(I  £  .  ,£) 

0  ^ noise  7  0  •'noise  7 

versus  (£  „,£  )  for  four  different  values 

07  17  noise7 


of  e  (0.01,  0.1,  1,  and  2).  Both  xi  and  x2  are 
almost  independent  on  the  random  noise 

£  .  (contours  are  almost  paralleling  to  the 

horizontal  axis)  when  the  initial  error  0)  is 

larger,  and  are  almost  independent  on  the 
tolerance  error  e  when  e  <  0.1 . 


Figures  2.  Contour  plots  of  T,(c f  ,<E  ,£) 

versus  (£  n,  £  )  for  four  different  values  of 

e  (0.01,  0.1,  1,  and  2)  using  Nicolis  model  with 
stochastic  forcing. 
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ffaa 

Figures  3.  Contour  plots  of  T2(gQ,  ^mise,  £) 
versus  (<f„,  t  )  for  four  different  values  of 

v  ^  (r  noise 7 

e  (0.01,  0.1,  1,  and  2)  using  Nicolis  model  with 
stochastic  forcing. 

6.  CONCLUSIONS 

(1)  There  are  two  model 
predictability  measures:  instantaneous  error 
and  predictability  time.  The  instantaneous 
error  measure  is  used  for  models  with  a 
given  initial  condition  error.  The  predictability 
time  measure  is  used  for  models  with 
uncertain  initial  condition  error. 

(2)  We  developed  a  theoretical 
framework  to  determine  the  predictability 
time  (t-i)  and  its  variability  (t2)  for  nonlinear 
stochastic  dynamical  system.  The  initial 
condition  error  (z0)  and  the  valid  prediction 
period  (f  -  t0)  are  treated  as  random 
variables.  The  joint  probability  density 
function,  P(t0,  z0,  t  -  f0),  satisfies  the 
backward  Fokker-Planck  equation  when  the 
random  variable  (f  -  f0)  is  assumed 
homogeneous.  This  equation  has  two 
independent  variables  (f,  z0)  and  given 
initial  and  boundary  conditions  (well-posed). 
After  solving  the  backward  Fokker-Planck 
equation,  it  is  easy  to  obtain  t-i  and  x2  since 
they  are  the  ensemble  mean  and  variance  of 
(f-  t0),  respectively. 

(3)  For  an  autonomous  dynamical 
system,  we  derived  time-independent 
second-order  linear  differential  equations  for 
t-i  and  t2  with  given  boundary  conditions. 


This  is  a  well-posed  problem  and  the 
solutions  are  easily  to  be  obtained. 

(4)  For  the  one-dimensional 
probabilistic  error  growth  model  (Nicolis 
1992),  the  second-order  ordinary  differential 
equations  of  Ti  and  t2  have  analytical 
solutions,  which  show  the  following  features 
of  t-i  and  t2:  (a)  decreasing  with  increasing 
initial  condition  error  (or  with  increasing 
random  noise),  (b)  increasing  with  the 
increasing  tolerance  error  e,  (c)  almost 
independent  on  e  with  small  tolerance  error 
(e  <  0.1). 

(5)  The  stochastic  forcing,  acting  as 
a  multiplicative  white  noise,  reduces  the 
Lyapunov  exponent  (increase  predictability 
time)  and  stabilizes  dynamical  system  (i.e., 
Nicolis’  one-dimensional  probabilistic  error 
growth  model).  On  the  other  hand,  the 
random  noise  decreases  the  predictability 
time  and  destabilizes  the  dynamical  system. 
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